On the Convergence Error in Loopy Propagation

نویسندگان

  • Janneke H. Bolt
  • Linda C. van der Gaag
چکیده

Reasoning with a Bayesian network amounts to computing probability distributions for the network’s variables. Pearl’s propagation algorithm provides for efficient reasoning with singly connected networks. When applied to a multiply connected network, the algorithm no longer yields exact probabilities, yet has been reported to result in good approximations. In this paper we provide some theoretical background to the algorithm’s performance on multiply connected networks. We indicate the two types of error that can arise in the probabilities computed by the algorithm and analyse the different factors that govern one of these errors.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Loopy belief propagation for approximate inference : an empiricalstudyKevin

Recently, a number of researchers have demonstrated excellent performance by using \loopy belief propagation" | using Pearl's polytree algorithm in a Bayesian network with loops. The most dramatic instance is the near Shannon-limit performance of \Turbo Codes" | error-correcting codes whose decoding algorithm is equivalent to loopy belief propagation. In this paper we ask: is there something sp...

متن کامل

Message Error Analysis of Loopy Belief Propagation for the Sum-Product Algorithm

Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The use of the belief propagation algorithm on graphical models with loops is referred to as Loopy Belief Propagation (LBP). Various sufficient conditions for convergence of LBP have been presented; however, general n...

متن کامل

Loopy Propagation: the Convergence Error in Markov Networks

Loopy propagation provides for approximate reasoning with Bayesian networks. In previous research, we distinguished between two different types of error in the probabilities yielded by the algorithm; the cycling error and the convergence error. Other researchers analysed an equivalent algorithm for pairwise Markov networks. For such networks with just a simple loop, a relationship between the e...

متن کامل

Sufficient Conditions for Convergence of Loopy Belief Propagation

We derive novel sufficient conditions for convergence of Loopy Belief Propagation (also known as the Sum-Product algorithm) to a unique fixed point. Our results improve upon previously known conditions. For binary variables with (anti-)ferromagnetic interactions, our conditions seem to be sharp.

متن کامل

Loopy Belief Propagation: Convergence and Effects of Message Errors

Belief propagation (BP) is an increasingly popular method of performing approximate inference on arbitrary graphical models. At times, even further approximations are required, whether due to quantization of the messages or model parameters, from other simplified message or model representations, or from stochastic approximation methods. The introduction of such errors into the BP message compu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005